UTILITY PATENT APPLICATION TRANSMITTAL 

(New Nonprovisional Applications Under 37 CFR § L53(b)) 



Attorney Docket No. 
1018.050US2 



o 



TO THE ASSISTANT COMMISSIONER FOR PATENTS: 



U 
■n 



Transmitted herewith is the patent application of ( ) application identifier or (X) first named inventor, Yi-Min Wang, entitled ~ 
Pattern- and Model-Based Power Line Monitoring, for a(n): 

(X) Original Patent Application. 

( ) Continuing Application (prior application not abandoned): 

( ) Continuation ( ) Divisional ( ) Continuation-in-part (CIP) 

of prior application No: Filed on: . 

( ) A statement claiming priority under 35 USC § 120 has been added to the specification. 



Enclosed are: 
(X) 
(X) 



Specification; 32 Total Pages. 



(X) Drawing(s); J_l_ Total Sheets, 



Oath or Declaration: 

(X) A Newly Executed Combined Declaration and Power of Attorney: 

( ) Signed. (X) Unsigned. ( ) Partially Signed. 

( ) A Copy from a Prior Application for Continuation/Divisional (37 CFR § 1 .63(d)). 

( ) Incorporation by Reference. The entire disclosure of the prior application, from which a copy of the 
oath or declaration is supplied, is considered as being part of the disclosure of the accompanying 
application and is hereby incorporated herein by reference. 
( ) Signed Statement Deleting Inventor(s) Named in the Prior Application. (37 CFR § 163(d)(2)). 
Power of Attorney. (X) Return Receipt Postcard. 

Associate Power of Attorney. ( ) A Check in the amount of $ for the Filing Fee. 

Preliminary Amendment ( ) Information Disclosure Statement and Form PTO-1449. 

A Duplicate Copy of this Form for Processing Fee Against Deposit Account. 
A Certified Copy of Priority Documents (if foreign priority is claimed). 
Statement(s) of Status as a Small Entity. 

Statements) of Status as a Small Entity Filed in Prior Application, Status Still Proper and Desired. 
Patent application data entry format sheets for OCR. 



CLAIMS AS FILED 


FOR 


NO. FILED 


NO. EXTRA 


RATE 


FEE 


Total Claims 


15 


0 


$18.00 


$ 0.00 


Independent Claims 


4 


1 


$78.00 


$ 78.00 


Multiple Dependent Claims (if applicable) 


$0.00 


Assignment Recording Fee 


$0.00 


Basic Filing Fee 


$690.00 


Total Filing Fee 


$ 768.00 



Charge $_ 



_ to Deposit Account . 



pursuant to 37 CFR § 1 .25. At any time during the pendency 



of this application, please charge any fees required or credit any overpayment to this Deposit Account 
Respectfully s 



By: 




Michael A. 

Date: 8-17-00 

Correspondence Address: 

Law Offices of Michael Dryja 
704 228th Avenue NE PMB 694 
Sammamish,WA 98074 
Phone: 425-427-5094 
Fax: 206-374-2819 



ia, Attorney ofRecord, Reg. No.^662 




I hereby certify that this is being deposited with the U.S. Postal 
Service "Express Mail Post Office to Addressee" service under 
37 CFR § 1.10 on the date indicated below and is addressed to: 



Assistant Commissioner for Patents 
Box Patent Application 
WashingtonJ^.C. 20231 





Typed Name: Michael A. Dryja 

Express Mail Label No.: EK994740864US 

Date of Deposit: 8-17-00 



Inventor Information 



Inventor One Given Name : : 
Family Name: : 
Postal Address Line One:: 
City: : 

State or Province: : 
Postal or Zip Code:: 
Citizenship Country: : 

Inventor Two Given Name : : 
Family Name: : 
Postal Address Line One:: 
City: : 

State or Province: : 
Postal or Zip Code:: 
Citizenship Country: : 

Inventor Three Given Name : : 
Family Name: : 
Postal Address Line One: : 
City: : 

State or Province:: 
Postal or Zip Code:: 
Citizenship Country: : 



Yi-Min 
Wang 

15802 SE 58th St 

Bellevue 

WA 

98004 
Taiwan 

Wilf G. 
Russell 

9616 173rd Place NE 

Redmond 

WA 

98052 
Canadian 

Anish K. 
Arora 

938 110th Av NE 

Bellevue 

WA 

98004 
India 



Correspondence Information 

Correspondence Customer Number:: 23441 
Telephone:: (425) 427-5094 

Fax:: (206) 374-2819 

Electronic Mail One:: mike@dryjapat.com 
Electronic Mail Two:: sherry@dryja.com 



Application Information 

Title Line One:: 
Title Line Two:: 
Total Drawing Sheets : : 
Formal Drawings?:: 
Application Type:: 
Docket Number:: 



Pattern- and Model -Based 
Power Line Monitoring 
11 
Yes 

Utility 
1018.050US2 



1 



Continuity Information 



This application is a:: 

> Application One:: 
Filing Date: : 

This application is a:: 

> Application Two:: 
Filing Date: : 



Non Prov. of Provisional 

60/149,390 

08-17-99 

Non Prov. of Provisional 

60/184,631 

02-24-00 



Representative Information 

Registration Number One:: 39,662 

Registration Number Two:: 32,628 

Registration Number Three:: 32,022 



2 



PATTERN- AND MODEL-BASED POWER LINE MONITORING 

RELATED APPLICATIONS 

This patent application claims priority to and the benefit of the previously filed 
provisional patent applications "Home Networking filed on August 17, 1999, and 
5 assigned serial no. 60/149,390 [attorney docket no. 1018.050US0], and "Home 

Networking System," filed on February 24, 2000, and assigned serial no. 60/184,631 
[attorney docket no. 141388.2]. 

FIELD OF THE INVENTION 

This invention relates generally to power line monitoring, and more particularly to 
10 an automation system for controlling and monitoring devices and sensors that performs 
power line monitoring. 

BACKGROUND OF THE INVENTION 

Home networking and automation have become more popular. With the number 
and complexity of audio/video equipment increasing, some homeowners are interested in 

15 operating their equipment more easily. Other homeowners are more concerned about the 
security and safety of their homes. These homeowners may want to remotely monitor 
their homes, remotely control appliances and other power line devices, and learn when 
important events occur. For example, an important event can be the hot water heater 
bursting or leaking, or another type of event. Power line devices are devices that connect 

20 to the power line, usually through a plug that connects to an electrical outlet. 

Currently, there are two popular home networking infrastructures. The first is 
phone line networking. To provide in-home networking of computers and computer 

1 



peripherals without requiring home rewiring, as is usually required with standard 
Ethernet networks, the Home Phone line Networking Alliance (HomePNA) was formed 
to leverage the existing phone lines in homes. More detailed information regarding the 
HomePNA can be found on the Internet at www.homepna.com. While phone line 

5 networking allows homeowners to create small local-area networks (LAN's) within their 
homes for the purposes of connecting computers and computer peripherals, it has 
limitations. Significantly, phone line networking typically does not allow homeowners to 
control appliances, lamps, and other power line devices within their homes. 

A second home networking infrastructure is power line networking. Power line 

10 networking provides ubiquitous wired connectivity throughout the majority of homes. 
One type of power line networking is known as X10. X10 is a communications protocol 
that allows for remotely controlling power line devices, such as lamps and appliances. 
More detailed information regarding the XI 0 protocol can be found on the Internet at 
ftp ://ftp . scruz.net/users/cichlid/public/x 1 Ofaq. 

1 5 Current power line networking, such as XI 0 networking, is limited. The XI 0 

protocol, for example, provides only a rudimentary and low-level framework for 
controlling and monitoring power line devices. The framework generally does not allow 
for sophisticated and complex device control applications. While automation systems 
employing existing XI 0 technology can be implemented using computers, more typically 

20 the systems are implemented with relatively less intelligent control centers that only 
govern a limited number of power line devices, in a limited manner. When computers 
are used, the resulting systems are still far from ideal. They may be difficult to use, and 
may not be reliable or robust against equipment failures and crashes. 



2 



An intelligent, reliable, and robust automation system that overcomes these 
problems is described in the cofiled patent application entitled "Automation System for 
Controlling and Monitoring Devices and Sensors" [attorney docket no. 1018.050US1]. 
The system can include power line monitoring, to determine whether power line devices 
5 are malfunctioning, or whether malicious intrusions are being attempted on the system. 
Such power line monitoring is the subject of this patent application. 

SUMMARY OF THE INVENTION 

The invention relates to power line monitoring. The monitoring can be performed 
in conjunction with an automation system designed to control and monitor devices and 

10 sensors. The devices can include power line devices, such as lamps, appliances, 

audio/video equipment, and other devices that connect to the power line of a house or 
other building. The sensors can include sensors for detecting the occurrence of 
emergency-related and other events. For example, a water sensor located near a hot 
water heater can detect whether the heater has burst, or is leaking. 

15 The power line monitoring can be model-based, pattern-based, or both. Model- 

based power line monitoring uses a model of acceptable power line activity. Activity that 
does not conform to the model is tagged as indicating a potential problem. Pattern-based 
power line monitoring uses patterns of unacceptable power line activity. Activity that 
matches one of the patterns is also tagged as indicating a potential problem. 

20 The invention can be used in conjunction with an automation system, such as the 

automation system described in this patent application. The invention can also be used in 
conjunction with another type of system, or independently from a system. The phrase 
"power line monitoring system" encompasses any type of system in which power line 
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monitoring is performed, such as an automation system. The invention encompasses 
automation systems, automation system architectures, power line monitoring systems, 
and methods of varying scopes. Other aspects, embodiments and advantages of the 
invention, beyond those described here, will become apparent by reading the detailed 
5 description and by referencing the drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a pictorial diagram of an example house in which an automation system 
can be implemented. 

FIG. 2 is a topological diagram of the automation system of FIG. 1. 
10 FIG. 3 is a diagram of a software architecture that can implement the automation 

system of FIGs. 1 and 2. 

FIG. 4 is a diagram showing how devices, sensors, and objects are registered with 
the look-up services of the software architecture of FIG. 3. 

FIG. 5 is a diagram showing how an object of FIG. 4 can be addressed in two 
15 different ways. 

FIG. 6 is a diagram showing the soft-state store of FIG. 3 in more detail. 
FIG. 7 is a diagram showing an abstract, high-level view of the software 
architecture of FIG. 3. 

FIG. 8 is a diagram showing a power line monitoring daemon as one example of 
20 the system management daemons of FIG. 3, according to an embodiment of the 
invention. 

FIG. 9 is a diagram showing how the power line monitoring daemon of FIG. 8 
detects patterns from the power line, according to an embodiment of the invention. 
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FIG. 10 is a flowchart of a method showing how one embodiment monitors the 
power line. 

FIG. 1 1 is a diagram of an example computerized device that can be used to 
implement an automation system. 

5 DETAILED DESCRIPTION OF THE INVENTION 

In the following detailed description of exemplary embodiments of the invention, 
reference is made to the accompanying drawings that form a part hereof, and in which is 
shown by way of illustration specific exemplary embodiments in which the invention 
may be practiced. These embodiments are described in sufficient detail to enable those 
10 skilled in the art to practice the invention. Other embodiments may be utilized, and 
logical, mechanical, electrical, and other changes may be made without departing from 
the spirit or scope of the present invention. The following detailed description is, 
therefore, not to be taken in a limiting sense, and the scope of the present invention is 
defined only by the appended claims. 

15 Automation System Hardware Architecture 

FIG. 1 shows a pictorial diagram 100 of an example house 102 in which an 
automation system can be implemented. The house 102 includes a garage 104, a kitchen 
106, a family room 108, a master bedroom 1 10, and a den 1 14, among other rooms. 
Connections coming into and distributed throughout the house 102 include a phone line 

20 1 16, a power line 1 18, and an Internet connection 120. The phone line 116 allows 

residents of the house 102 to place and receive phone calls. The power line 118 provides 
electrical power to the house 102. The Internet connection 120 connects the house 102 to 
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the Internet. The Internet connection 120 can be a fast, always-on broadband connection, 
such as a cable modem connection or a Digital Subscriber Loop (DSL) line. The Internet 
connection 120 may also be a slow, dial-up connection that utilizes the phone line 116. 
Not specifically called out in FIG. 1 is that a network has been set up within the 

5 house 102. The network is of the type that connects computers and computer peripherals 
with one another. For example, the network may be an Ethernet network, using 
dedicated wiring, or using the existing phone line 1 16. The network may also be a 
wireless Ethernet network, or another type of network. For purposes of descriptive 
clarity, this network is referred to as the backbone network in the detailed description. 

10 The backbone network is distinct from a power line network, for example. 

Each of the rooms of the house 102 has a number of network adapters and 
electrical outlets, as well as other types of components. The garage 104 has four 
components pertinent to the automation system. The video camera 122 allows remote 
monitoring of whether the garage door 124 is open or closed. The camera 122 is 

15 preferably directly connected to the backbone network set up within the house 102. The 
network adapter 128, as well as other network adapters throughout the house 102, 
provide for connectivity to the backbone network. The garage door opener 130 controls 
the opening and closing of the garage door 124, and is connected to the backbone 
network through the network adapter 128. 

20 Electrical power devices that may be controlled using the automation system can 

be plugged into the electrical outlet 126, or into other electrical outlets throughout the 
house 102. Electrical power devices are also referred to as power line devices. Power 
line devices include appliances, lamps, audio/video equipment, and other types of devices 
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that are plugged into electrical outlets. The power line devices are typically independent 
from one another. For example, a power line device that is a lamp is independent from a 
power line device that is a clock radio, in that the lamp and the clock radio are not aware 
of each other. The lamp and the clock radio can each be independently controlled by the 

5 automation system. 

In an alcove 132 off the garage 104, there is a hot water heater 134 and a furnace 
136. Relevant to the automation system is the water sensor 138, which is connected to 
the backbone network through the network adapter 140. The water sensor 138 is located 
on the floor of the alcove 132 and detects the presence water, which may indicate that the 

10 hot water heater 134 is leaking or has burst. 

The kitchen 106 likewise has an electrical outlet 138 and a network adapter 140. 
As shown in FIG. 1, the kitchen also includes a radio-frequency (RF) device 142. The 
RF device 142 communicates with an RF bridge 144 that is wired to the backbone 
network. An example of the RF device 142 is a wireless temperature gauge that 

15 periodically sends the detected temperature via RF signals to the RF bridge 144. The den 
1 14 in particular includes the RF bridge 144, connected to the backbone network through 
the network adapter 146, with which the RF device 142 communicates. The family room 
108 also has an RF device 148. The RF bridge 144 receives RF signals transmitted by 
the RF devices 142 and 148, and passes them through to the backbone network set up in 

20 the house 102 via the network adapter 146. The RF bridge 144 also receives data from 
the backbone network intended for the RF devices 142 and 148, and passes them through 
to the devices 142 and 148 by conversion to RF signals. 



7 



A user access point (UAP) 101 is located in the kitchen 106. The UAP 101, and 
other UAP's throughout the house 102, permit users of the automation system to interact 
with the system. The UAP 101 can be a touch-screen, flat-screen device mounted on a 
wall of the kitchen 106. The user provides input to the automation system by touching 

5 the device, and receives output from the system by viewing the screen of the device. The 
UAP 101 can also be a computer, or another type of device. 

The family room 108, in addition to the RF device 148, includes electrical outlets 
150 and 152, and a network adapter 154. Audio/video (A/V) devices 156 are connected 
to an A/V bridge 158, through which the A/V devices 156 can send and receive audio, 

10 video, and control signals through the backbone network set up in the house 102. The 
A/V bridge 158 is connected to the backbone network through the network adapter 154. 
The family room 108 has a thermostat 160 for controlling the heating and cooling system 
of the house 102. The heating and cooling system includes, for example, the furnace 136 
in the alcove 132 off the garage 104. The thermostat 160 is preferably connected directly 

15 to the backbone network set up in the house 102. A UAP 103 is also located in the 
family room 108. 

The master bedroom 1 10 has a network adapter 162 and an electrical outlet 164. 
Of particular relevance to the automation system is that a device adapter 166 is directly 
plugged into the electrical outlet 164, and a lamp 168 is plugged into the device adapter 
20 166. The device adapter 166 allows the automation system to control non-intelligent 
power devices, such as the lamp 168. A subsequent section of the detailed description 
describes the construction and the use of the device adapter 166. A UAP 105 is also 
located in the master bedroom 110. 
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The den 1 14 is the room of the house 102 in which the heart of the automation 
system is located. There are four computing devices 174, 176, 178, and 180. The 
computing devices may be desktop or laptop computers, for example. The computing 
device 174 serves as the gateway device, through which the backbone network set up in 

5 the house 102 is connected to the Internet connection 120. The devices 176, 178, and 
180 provide the hardware on which the software architecture of the automation system is 
implemented in a distributed manner. The software architecture is described in detail in a 
subsequent section of the detailed description. There is more than one such device for 
redundancy and reliability purposes. The devices 174, 176, 178, and 180 connect to the 

1 0 backbone network through the network adapter 1 82, and can receive power through the 
electrical outlet 184. 

The four computing devices 174, 176, 178, and 180 can be located throughout the 
house 102, instead of in a single room, such as the den 1 14. This may be desirable where 
one or more of these computing devices also serves as a UAP. Furthermore, if a circuit 

1 5 breaker for the room where one of the computing devices is located trips, only one 

computing device is affected. The automation system will still be able to operate over the 
other, unaffected computing devices. 

The RF bridge 144 of the den 114 allows the RF devices 142 and 148, in the 
kitchen 106 and the family room 108, respectively, to communicate with other devices on 

20 the backbone network set up in the house 1 02. The RF bridge 144 is connected to the 
backbone network through the network adapter 146, and receives power through the 
electrical outlet 186. There are two other bridges in the den 114, the IR bridge 188, and 
the power bridge 192. The infrared (IR) bridge 188 allows the IR device 190, and other 
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IR devices, to communicate with devices on the backbone network. The IR device 190 
sends IR signals to and receives IR signals from the IR bridge 188, and vice-versa. 
Examples of the IR device 190 include a video-cassette recorder (VCR) and a remote 
control, although the device 190 can be any type of device. IR signals differ from RF 

5 signals in that they require a direct line of sight between the sender and the receiver, 
unlike RF signals. The IR bridge 188 receives power from the electrical outlet 194, and 
is connected to the backbone network through the network adapter 196. 

The power bridge 192 allows devices connected to the power line 118 of the 
house 102 via electrical outlets to communicate with devices on the backbone network. 

10 The power bridge 192 is connected to the backbone network through the network adapter 
182, and through the electrical outlet 198 receives power and communicates with the 
devices connected to the power line 118. For example, the lamp 168 in the master 
bedroom 1 10 can be controlled and monitored by the automation system. The device 
adapter 166 situated between the lamp 168 and the electrical outlet 164 sends and 

1 5 receives signals over the power line 118. The power bridge 1 92 transfers these signals 
from the power line 1 1 8 to the backbone network set up in the house 102. 

While the automation system has been shown in FIG. 1 as implemented in a 
house, the system can also be implemented in other types of buildings as well. For 
example, the automation system can be implemented in an office building, a church, a 

20 store, a mall, or another type of building. The automation system can also be 

implemented without regard to a physical structure, such as a building. The components 
controlled and used by the automation system of FIG. 1 are representative components, 
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and are not all required to implement the automation system. As an example, the IR 
device 190 and the RF devices 142 and 148 may be omitted. 

FIG. 2 shows a diagrammatic topology of the automation system of FIG. 1, 
providing another view of the system. The automation system is called out as the system 

5 200 in FIG. 2. The backbone network 202 is preferably an Ethernet network, 

implemented over a dedicated line or over the phone line 1 16 of FIG. 1 . The system 
devices 204 include the devices 174, 176, and 178. The devices 204 connect to the 
backbone network 202 through the network adapter 182. The device 174 is the gateway 
device that connects to the Internet connection 120. The user access points (UAFs) 206 

10 include the UAP's 101, 103, and 105. The UAP's 206 are preferably directly connected 
to the backbone network 202. Likewise, the thermostat 160 is directly connected to the 
backbone network 202, whereas the water sensor 138 is connected to the backbone 
network 202 through the network adapter 140. The audio/video (AN) devices 156 are 
connected to the AN bridge 158, which is connected to the backbone network 202 

15 through the network adapter 154. The AN bridge 158 enables the AN devices 156 to 
communicate with devices on the backbone network 202. 

The power bridge 192 is connected to the backbone network 202 through the 
network adapter 182. Two instances of the same network adapter 182 are shown in FIG. 
2 for illustrative clarity. The power bridge 192 is connected to the power line 118 

20 through the electrical outlet 198. Smart power devices 208 directly connect to the power 
line 118 through corresponding electrical outlets 210, and can directly communicate with 
the power bridge 192. By comparison, non-intelligent power devices require interstitial 
device adapters between them and their corresponding electrical outlets. For example, 
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the lamp 168 requires the device adapter 166 between it and the electrical outlet 164 for 
the automation system to control and monitor the lamp 168. Moving to the right of the 
power bridge 192 on the backbone network 202 in FIG. 2, the garage door opener 130 is 
connected to the backbone network 202 through the network adapter 128. The video 

5 camera 122 is directly connected to the backbone network 202. 

The infrared (IR) bridge 188 is connected to the backbone network 202 through 
the network adapter 196, while the radio frequency (RF) bridge 144 is connected to the 
backbone network 202 through the network adapter 146. The IR bridge 188 enables the 
IR devices 212, such as the IR device 192, to communicate with devices on the backbone 

10 network 202. Likewise, the RF bridge 144 enables the RF devices 214, such as the RF 
devices 142 and 148, to communicate with devices on the backbone network 202. 

Automation System Software Architecture 

FIG. 3 is a diagram 300 showing a software architecture 302 for the automation 
system described in the previous section of the detailed description. The software 

15 architecture 302 specifically has three layers, a system infrastructure layer 304, an 

application layer 306, and a user interface layer 308. The software architecture 302 is 
preferably implemented over the system devices 204 of FIG. 2, such as the devices 176, 
178, and 180. An overview of each layer of the architecture 302 is described in turn. 
The architecture 302, which is the central and critical aspect of the software architecture, 

20 is then described in more detail. 

The system infrastructure layer 304 includes look-up services 310, a 
publication/subscription eventing component 312, system management daemons 314, and 
a soft-state store 316. The soft-state store 316 manages the lifetime and replication of 
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soft-state variables. The publication/subscription eventing component 312 enables 
objects, daemons, programs, and other software components to subscribe to events 
related to changes in the soft-state store 316. The look-up services 310 interact with 
devices and sensors of the automation system, which are indicated by the arrow 318. 

5 Specifically, the look-up services 310 include a name-based look-up service (NBLS) 320, 
and an attribute-based look-up service (ABLS) 322. The ABLS 322 maintains a database 
of available devices, and supports queries based on device attributes. The device 
attributes can include device type and physical location, among other attributes. The 
NBLS 320 maintains a database of running instances of objects, and supports name-to- 

10 object address mapping. The system management daemons 314 of the system 
infrastructure layer 304 detect failures of devices, and initiate recovery actions. 

The application layer 306 includes automation applications 324, device objects 
326, and device daemons 328. There are two types of automation applications 324, 
device-control applications, and sensing applications. Device-control applications 

15 receive user requests as input, consult the look-up services 310 to identify the devices and 
the device objects 326 that should be involved, and perform actions on them to satisfy the 
requests. The device objects 326 correspond to the devices and sensors identified by the 
arrow 318. The device objects 326 encapsulate device- and network-specific details of 
their corresponding devices, and present interfaces for them, such as method calls. 

20 Examples of the device objects 326 include camera objects for taking snapshots and 
recording video clips, and garage door opener objects for operating garage doors. 

Sensing applications monitor environmental factors, and take actions when a 
monitored event occurs. The sensing applications subscribe to events through the 
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eventing component 312. Device daemons 328 interact with the devices and sensors 
identified by the arrow 3 1 8, and independently act as proxies for them. For example, a 
device daemon for a sensor can monitor sensor signals, and update appropriate soft-state 
variables in the soft-state store 316 to trigger events. 

5 The user interface layer 308 provides user access to the system infrastructure 

layer 304 and the application layer 306. The user interface layer 308 has three parts, a 
web browser interface 330, a voice-recognition interface 332, and a text-based natural 
language parser interface 334. The browser interface 330 enables the user to browse 
through available devices, select devices based on attributes, and control the devices. 

10 The text-based natural language parser interface 334 is based on a vocabulary appropriate 
to an automation system, while the voice-recognition interface 332 employs voice 
recognition technology based on the same vocabulary. 

The user interface layer 308 preferably supports remote automation. For 
example, when the Internet connection 120 is an always-on connection, the browser 

15 interface 330 can be used to access the automation system from remote locations. The 
natural language parser interface 334 provides an email-based remote automation 
interface. The email daemon 336 periodically retrieves email through the Internet 
connection 120, and parses automation-related requests contained in the email. The 
daemon 336 passes the requests to the automation applications 324, and optionally sends 

20 reply email confirming that the requested actions have taken place. Known digital 
signature and data encryption technologies can be used to ensure the security of the 
email. If the user has a mobile phone 338 that supports text messaging, the email daemon 
336 can alert the user with text messages when predetermined events occur. The voice- 
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recognition interface 332 can optionally be used with the mobile phone 338, or another 
type of phone. 

FIG. 4 is a diagram 400 showing how one embodiment registers devices, sensors, 
and objects with the look-up services 310. The devices and sensors that are registered 

5 include the devices and sensors pointed to by the arrow 3 18 in FIG. 3. The devices 
include smart devices 208, fixed devices 402, and dynamic devices 404. Smart devices 
208 are devices that do not need a device adapter to interact with the system. Fixed 
devices 402 are devices that are permanently affixed at their location, and cannot be 
moved. An example of a fixed device is the garage door opener 130 of FIGs. 1 and 2, 

10 which is permanently affixed to a garage wall. The fixed devices 402 also include 

electrical outlets and wall switches. Dynamic devices 404 are devices that can be moved. 
An example of a dynamic device is the lamp 168 of FIGs. 1 and 2, which can be 
unplugged from one room and moved to another room. The objects that are registered 
include the device objects 326 of FIG. 3, as well as computation objects 406. 

1 5 Computation objects 406 do not correspond to any particular device, but are used by 
daemons, applications, and other components of the automation system. Example 
computation objects include language parser objects and voice recognition objects. 

Through the ABLS administration console 408, the user performs a one-time 
manual task of assigning unique addresses to the fixed devices 402, which registers the 

20 devices 402 with the ABLS 322. The unique address can be XI 0 addresses. Additional 
attributes may be entered to associate the devices 402 with physical-location attributes. 
For example, a wall switch in the garage can be indicated as the "garage wall switch," in 
addition to having a unique address. Dynamic devices 404 have their device attributes 



15 



announced to the ABLS 322 when they are plugged in and switched on, through the 
device daemons 328 that act as proxies for the devices 404. Device objects 326 for the 
dynamic devices 404 are instantiated when an application requests to control the devices 
404. The objects 326 can persist for a length of time, so that repeated requests do not 

5 require repeated instantiation. The device objects 326 are instantiated by the NBLS 320. 
Smart devices 208 perform their own registration with the ABLS 322. Computation 
objects 406 are instantiated by the NBLS 320, and require a software component or 
service referred to as the computation object installer 420 to register with the ABLS 322. 
FIG. 5 is a diagram 500 showing how one embodiment addresses an object 502 in 

10 two different ways. The object 502 can be one of the device objects 326 of FIG. 4, or one 
of the computation objects 406 of FIG. 4. The object 502 has one or more synchronous 
addresses 304, and one or more asynchronous addresses 306. The synchronous addresses 
504 can include an address in the form of a marshaled distributed-object interface pointer, 
or another type of reference that enables real-time communication with the object 502. 

15 The asynchronous addresses 306 can be in the form of a queue name, a marshaled handle 
to a queue, or other address. The asynchronous addresses 306 are used to asynchronously 
communicate with the object 502 when it is temporarily unavailable or too busy, or when 
synchronous communication is otherwise not desired. 

Referring back to FIG. 4, in summary, the ABLS 322 of the look-up services 310 

20 maintains a database of available devices and sensors. The ABLS 322 supports queries 
based on combinations of attributes, and returns unique names of the devices and sensors 
that match the queries. By allowing identification of devices and sensors by their 
attributes and physical locations, instead of by their unique addresses, the ABLS 322 
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enables user-friendly device naming. For example, the user can identify a device as "the 
lamp on the garage side of the kitchen," instead of by its unique address. The NBLS 320 
of the look-up services 310 maps unique names to object instances identified by those 
names. The NBLS 320 is optionally extensible to allow mapping of a unique name to 
5 multiple object instances. Both the ABLS 322 and the NBLS 320 are robust against 

object failures and non-graceful termination because they are based on the soft-state store 
316 of FIG. 3. 

FIG. 6 is a diagram 600 showing one embodiment of the soft-state store (SSS) 
316 in more detail. The SSS 316 uses a persistent, or non-volatile, store 608, and a 

10 volatile store 606. The persistent store 608 is used in addition to the volatile store 606 to 
save soft-state variables over failures, such as system crashes. The persistent store 608 
can be a hard disk drive, non- volatile memory such as flash memory, or other non- 
volatile storage. The volatile store 606 can be volatile memory, such as random-access 
memory, or other volatile storage. 

15 The SSS 316 ultimately receives heartbeats 602, and stores them as soft-state 

variables in either the persistent store 608 or the volatile store 606. The heartbeats 602 
are periodic refreshes from devices, sensors, objects, and daemons, so that the automation 
system knows they are still operating. The heartbeats 602 include device heartbeats 610, 
sensor heartbeats 612, object heartbeats 614, and daemon heartbeats 616. The refresh 

20 rates of the heartbeats 602 vary by their type. The daemon heartbeats 616 may be 
received over intervals of seconds. The object heartbeats 614 may be received over 
intervals of tens of seconds to minutes. The sensor heartbeats 612 maybe received over 
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intervals of minutes to hours. The device heartbeats 610 may be received over intervals 
from hours to days. 

The device heartbeats 610 and the sensor heartbeats 610 are received by the SSS 
316 through the ABLS 322, while the object heartbeats 614 are received by the SSS 316 

5 through the NBLS 320. The SSS 316 directly receives the daemon heartbeats 616. 
When an entity does not send a heartbeat as required by its refresh rate, the entity 
ultimately times out and is removed from the ABLS 322 and the NBLS 320. An entity in 
this context refers to a device, sensor, object, or daemon. 

The SSS 316 preferably performs soft-state variable checkpointing. For a given 

10 refresh rate threshold, heartbeats that occur above the threshold, and thus are updated 

with high frequency, remain in the volatile store 606, to decrease overhead. Recovery of 
these high-frequency heartbeats from failure of the SSS 316 is through new refreshes. 
Conversely, heartbeats that occur below the threshold, and thus are updated with low 
frequency, are persisted in the persistent store 608. Recovery of these low-frequency 

15 heartbeats from failure of the SSS 316 is through restoration of the persistent soft-state 
variables in the store 608. This is because waiting for the next heartbeat may take too 
long. Downtime of the SSS 316 is preferably treated as missing refreshes for the soft- 
state variables. 

The publication/subscription eventing component 312 allows subscriptions to 
20 events resulting from the change, addition, or deletion of the soft-state variables 

maintained by the SSS 316. The subscribers can include applications, daemons, and 
other software components of the automation system. The eventing component 312 
sends events to subscribers when the kinds of changes to the SSS 316 match their 
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corresponding event subscriptions. The component 312 receives the changes in the soft- 
state variables from the SSS 316. From these changes, it formulates events as necessary. 

As a summary of the software architecture described in this section of the detailed 
description, FIG. 7 is a diagram 1000 showing a high-level view of the architecture. The 

5 software architecture 302 resides between the power line 1 18 and the Internet connection 
120. The architecture 302 abstracts the manner by which the devices connected to the 
power line 1 1 8 are accessed and controlled. The Internet connection 120 provides for 
remote, off-site access and control of devices connected to the power line 118, through 
the architecture 302. The notification path 1008 indicates that notifications from the 

10 devices connected to the power line 118 move up to the software architecture 302. The 
notifications can also move up to the Internet connection 120 in the case of remote, off- 
site access and control of the devices. The control path 1010 indicates that control of the 
devices originates either from the Internet connection 120 or at the architecture 302, and 
moves down to the power line 1 18 to reach the devices. 

15 Power Line Monitoring 

FIG. 8 is a diagram 700 showing one embodiment of the system management 
daemons 314 of FIG. 3 in more detail. In particular, the system management daemons 
include a power line monitoring daemon 702. The power line monitoring daemon 702 
detects reliability, security, and other problems with automation system devices that use 

20 the power line. The daemon 702 can use pattern-based detection for detecting 

unacceptable power line activity, model-based detection for detecting acceptable power 
line activity, or both. Pattern-based detection employs a database of unacceptable power 
line patterns that, if detected, trigger an event. For example, faulty devices and external 
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interferences may produce meaningless repetitions or interleaving of commands. By 
comparison, model-based detection employs a model of acceptable power line patterns. 
Power line patterns that do not conform to the model also trigger an event. The daemon 
702 is referred to generically as a mechanism. 

5 FIG. 9 is a diagram 800 showing how one embodiment uses the power line 

monitoring daemon 702 to detect problems on the power line 118. The daemon 702 
monitors the power line 1 18 for problems that result from intrusions 802, atypical 
behaviors 804, and interferences 806. The daemon 702 matches patterns from the power 
line 118 against unacceptable power line patterns stored in the pattern database 808. The 

1 0 daemon 702 also tests the patterns against the pattern model 8 1 0 of acceptable power line 
patterns. If matching the patterns against the unacceptable power line patterns stored in 
the database 808 yields a positive match, or testing the patterns against the model 810 of 
acceptable power line patterns yields a negative test, the daemon 702 generates an event. 
The event corresponds to the situation that an unacceptable pattern has been detected on 

1 5 the power line 1 18. Other daemons, objects, and programs can subscribe to the event 
through the eventing component 312, which is not specifically called out in FIG. 9. 

The monitoring daemon 702 maintains a log file 812 of all detected power line 
patterns. The patterns stored in the log file 812 include both acceptable and unacceptable 
power line patterns. An analysis tool 814 can be used by a user to determine whether to 

20 add new unacceptable power line patterns to the database 808, based on the patterns 
stored in the log file 812. The analysis tool 814 can also be used to determine whether 
the model 810 of acceptable power line patterns should be modified, based on the 
patterns stored in the log file 812. 
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For pattern-based detection of unacceptable power line activity, power line 
transmissions are monitored to detect whether they satisfy specified patterns of bad 
behavior. For example, a normal XI 0 transmission sequence includes one or more 
address commands of the same house code, followed by one function command of that 

5 same house code. For transceiver interference problems, the pattern of bad behavior 
observed is "within the last AS time, K or more function commands of the same house 
code were transmitted consecutively on the power line/' For faulty interference 
problems, the pattern of unacceptable behavior is "within the last AT time, there were L 
or more transmission bursts on the power line in each of which either M or more address 

1 0 commands with the same unit code were transmitted consecutively, or N or more 

identical function commands were transmitted consecutively." In these expressions, K, 
L, M, and N are integer constants. They can be set to 25, 15, 5, and 5, respectively. The 
constants AS and AT are real-time constants, and can be set to about 2 minutes each. 

Monitors preferably are not manually implemented for each observed pattern on a 

1 5 case-by-case basis. This is because the number of unacceptable behavior patterns can be 
expected to increase as incident reports are collected and experience is gained with the 
fault types in power line devices. Observed patterns are instead all expressed in an 
extended regular expression language. The extensions allow the parameterized matching 
of events, for succinct specification of bad behaviors. The extensions also allow event 

20 matching in conjunction with satisfaction of state predicates, such as Boolean expressions 
on the system state. The purpose of event matching is to capture scenarios where 
transmission sequences are normal but where they violate access rights, or attempt to 
access bogus addresses that are not used in a particular deployment. 
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A power line language can be used where 2 is the finite set of events, s is the null 
event, ev is a variable of some type of event, x is an event parameter ranging over all 
possible values in the domain of ev, and E is an expression. Atomic expressions have one 
of the following forms: an event e, the null event s, and the parameterized event ev=x. 

5 Expressions have one of the following forms: £*, E + ,E K f E\ F, or£ + F. £* denotes 0 
or more occurrences of E. E + denotes 1 or more occurrences of E. E K denotes K 
occurrences of E. E\ F denotes E followed by F. E + F denotes the nondeterministic 
choice E or F. The parameterized event ev=x abbreviates the nondeterministic choice 
over an event of type ev. The event parameter x is scoped. Multiple occurrences of ev=x 

1 0 within the scope of x in an expression are matched with the same choice. That is, x is 
existentially quantified over its scope. Unless explicitly specified, the scope of an event 
parameter is the entire expression. For example, if 2= {a, b, c) and the domain of is 
{a, b} 9 then the expression ((ev=x); c; (ev=x)*) abbreviates to (a; c; a*) + (b; c; b*). As 
a convenience, the symbol 2* is overloaded to abbreviate the expression that denotes the 

15 do-not-care event, which is a nondeterministic choice over all events in 2. 2* thus 
denotes 0 or more occurrences of events. 

Where 2 denotes the events that can occur on the power line, a first pattern 
reduces to detecting the following regular expression on the power line within AS time. 

2*; (Function _Command=x) K ; 2* (1) 

20 The parameter x is a parameter that ranges over the set of function command values. The 
parameter expression Function _Command=x is a parameter expression that matches 
events that are function commands x. The prefix and suffix 2* subexpressions capture 
the normal transmissions that may occur within the AS time interval before or after the 
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bad pattern, which consists of K identical function commands transmitted consecutively. 

They also capture the case where more than K identical function commands are 

transmitted consecutively. As another example, a second pattern reduces to detecting the 

following expression on the power line within AT time. 

5 (S*; ((3y (Address _Command_Unitcode=y) M )+ (2) 

(3z (Function _Command=zf))) L \ 2* 

The expression Address jCommand_Unitcode=y is an expression that matches events that 
are address commands with unit codey. (3y ...) denotes the scope of parameter >\ 

1 0 Upon detecting the first pattern (1 ), the power line monitoring daemon 702 

queries the ABLS 322 of FIGs. 3, 4, and 6 for the X10 receiver gating the transceiver for 
house code x. The daemon 702 tries to power it off to see if the bad pattern stops. Upon 
detecting the second pattern (2), the daemon 702 tries to locate and power off all power 
line bridges one by one to see if the problem is caused by a faulty bridge. The power line 

15 bridges, for example, can include the bridge 192 of FIGs. 1 and 2. In either case, if the 
problem is not eliminated, the daemon 702 suspects an intruder has caused the pattern. 

For model-based detection of acceptable power line activity, power line 
transmissions are monitored to detect whether they satisfy a predetermined model of 
good behavior. The predetermined model is initially constructed by training a model 

20 based on known acceptable power line activity. For example, the model can be a 

probabilistic model, a statistical model, a Bayesian network, a Support Vector Machine 
(SVM), a classifier, or another type of model. Once it has been trained, the model can be 
tested against collected data, and modified as necessary to produce the optimal 
monitoring results. 
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The model can be continually retrained within the automation system on an ad 
hoc basis, or by a vendor on a more widespread basis, so that it becomes more accurate 
over time. For example, with respect to the former, power line monitoring that detects 
unknown, and presumably bad, behavior can be alerted to a user, who can make a 

5 decision as to whether the behavior is unacceptable. If it is acceptable, then the model 
can recalibrate itself so that this type of behavior will not be triggered as unacceptable 
when detected in the future. As another example, with respect to the latter, as the vendor 
obtains more power line activity data, it can retrain the model, and issue periodic updates. 
Pattern-based detection of unacceptable power line activity and model-based 

10 detection of acceptable power line activity can be performed independent of each other, 
and independent of an automation system. For example, pattern-based detection of 
unacceptable power line activity and model-based detection of acceptable power line 
activity can be performed independent of the automation system described in previous 
sections of the detailed description. 

1 5 FIG. 1 0 is a flowchart of a method 1 1 00 showing how one embodiment monitors 

power line activity. The method 1 1 00 can be performed by the power line monitoring 
daemon 702 of FIGs. 8 and 9. In 1 102, a power line pattern of activity is detected. The 
power line pattern is tested in 1 104 against a database of known unacceptable power line 
patterns, against a model of acceptable power line patterns, or against both. The database 

20 can be the database 808 of FIG. 9, while the model can be the model 810 of FIG. 9. If 
the detected pattern is not found in the database, or does satisfy the model, then the 
method 1100 proceeds from 1 106 to 1 108, where the detected power line pattern is 
deemed acceptable. However, if the detected pattern is found in the database, or does not 
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satisfy the model, the method 1 100 proceeds from 1106 to 1110, corresponding to the 
situation where the pattern has been deemed unacceptable. An appropriate predetermined 
action is performed in 1 1 10, or an appropriate event is generated. For example, a user 
can be alerted if the power line monitoring is being performed in conjunction with an 
5 automation system. 

Example Computerized Device 

The automation system can be implemented within a computerized environment 
having one or more computerized devices. The diagram of FIG. 1 1 shows an example 
computerized device 1400. The device 1400 can implement one or more of the system 

10 devices 204 of FIG. 2, or one or more of the user access points 206 of FIG. 2. The 
example computerized device 1400 can be, for example, a desktop computer, a laptop 
computer, or a personal digital assistant (PDA), The automation system may be practiced 
with other computer system configurations as well, including multiprocessor systems, 
microprocessor-based or programmable consumer electronics, network computers, 

1 5 minicomputers, and mainframe computers. The system may be practiced in distributed 
computing environments where tasks are performed by remote processing devices that 
are linked through a communications network. 

The device 1400 includes one or more of the following components: processor(s) 
1402, memory 1404, storage 1406, a communications component 1408, input device(s) 

20 1410, a display 1412, and output device(s) 1414. For a particular instantiation of the 

device 1400, one or more of these components may not be present. For example, a PDA 
may not have any output device(s) 1414. The description of the device 1400 is to be used 
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as an overview of the types of components that typically reside within such a device, and 
is not meant as a limiting or exhaustive description. 

The processor(s) 1402 may include a single central-processing unit (CPU), or a 
plurality of processing units, commonly referred to as a parallel processing environment. 

5 The memory 1404 may include read-only memory (ROM) and/or random-access memory 
(RAM). The storage 1406 may be any type of storage, such as fixed-media storage 
devices and removable-media storage devices. Examples of the former include hard disk 
drives, and flash or other non-volatile memory. Examples of the latter include tape 
drives, optical drives like CD-ROM drives, and floppy disk drives. The storage devices 

1 0 and their associated computer-readable media provide non-volatile storage of computer- 
readable instructions, data structures, program modules, and other data. Any type of 
computer-readable media that can store data and that is accessible by a computer can be 
used. 

The device 1400 may operate in a network environment. Examples of networks 
15 include the Internet, intranets, extranets, local-area networks (LAN's), and wide-area 
networks (WAN's). The device 1400 may include a communications component 1408, 
which can be present in or attached to the device 1400. The component 1408 may be one 
or more of a network card, an Ethernet card, an analog modem, a cable modem, a digital 
subscriber loop (DSL) modem, and an Integrated Services Digital Network (ISDN) 
20 adapter. The input device(s) 1410 are the mechanisms by which a user provides input to 
the device 1400. Such device(s) 1410 can include keyboards, pointing devices, 
microphones, joysticks, game pads, and scanners. The display 1412 is how the device 
1400 typically shows output to the user. The display 1412 can include cathode-ray tube 
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(CRT) display devices and flat-panel display (FPD) display devices. The device 1400 
may provide output to the user via other output device(s) 1414. The output device(s) 
1414 can include speakers, printers, and other types of devices. 

The methods that have been described can be computer-implemented on the 

5 device 1400. A computer-implemented method is desirably realized at least in part as 
one or more programs running on a computer. The programs can be executed from a 
computer-readable medium such as a memory by a processor of a computer. The 
programs are desirably storable on a machine-readable medium, such as a floppy disk or 
a CD-ROM, for distribution and installation and execution on another computer. The 

10 program or programs can be a part of a computer system, a computer, or a computerized 
device. 

Conclusion 

It is noted that, although specific embodiments have been illustrated and 
described herein, it will be appreciated by those of ordinary skill in the art that any 
1 5 arrangement that is calculated to achieve the same purpose may be substituted for the 
specific embodiments shown. This application is intended to cover any adaptations or 
variations of the present invention. Therefore, it is manifestly intended that this invention 
be limited only by the claims and equivalents thereof. 
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We claim: 

1 . A method comprising: 

detecting a power line activity pattern on a power line; 
determining whether the power line activity pattern is unacceptable; and, 
5 upon determining that the power line activity pattern is unacceptable, performing a 
predetermined action. 

2. The method of claim 1 , wherein determining whether the power line activity pattern 
is unacceptable comprises testing the power line activity pattern against a database of 
unacceptable power line activity patterns. 

10 3 . The method of claim 1 , wherein determining whether the power line activity pattern 
is unacceptable comprises testing the power line activity pattern against a model of 
acceptable power line activity. 

4. The method of claim 1, wherein performing a predetermined action comprises 
alerting a user. 

15 5 . The method of claim 1 > wherein performing a predetermined action comprises 
generating an event. 

6. The method of claim 1 , wherein the method is performed by execution of a computer 
program stored on a machine-readable medium by a processor. 
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7. A power line monitoring system comprising: 

a power line monitoring daemon to detect a power line activity pattern and test the 
pattern for tmacceptability; and, 

a database of unacceptable power line activity patterns against which the power line 
monitoring daemon tests the pattern for unacceptability, the daemon performing an action 
in response to the pattern being unacceptable. 

8. The system of claim 7, further comprising: 

a log file to which the daemon logs the power line activity pattern detected; and, 
an analysis tool to enhance the database based on the power line activity pattern 
detected. 

9. A power line monitoring system comprising: 

a power line monitoring daemon to detect a power line activity pattern and test the 
pattern for unacceptability; and, 

a model of acceptable power line activity behavior against which the power line 
monitoring daemon tests the pattern for unacceptability, the daemon performing an action 
in response to the pattern being unacceptable. 

10. The system of claim 9, further comprising: 

a log file to which the daemon logs the power line activity pattern detected; and, 
an analysis tool to enhance the model based on the power line activity pattern 
detected. 
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1 1. An architecture for an automation system, the automation system to control and 
monitor a plurality of devices, the architecture comprising: 

at least one look-up service to maintain at least one database of the plurality of 
devices by a plurality of device attributes including device type and physical location, 
and of aplurality of device objects corresponding to the plurality of devices by mapping 
a name for each device object to at least one address for each device object; 

a soft-state store to manage at least periodic refresh information for the plurality of 
devices and the plurality of device objects, the refresh information managed by the soft- 
state store as a plurality of soft-state variables; 

a publication/subscription eventing component to enable subscriptions to events 
related to changes in the plurality of soft-state variables managed by the soft-state store; 
and, 

a power line monitoring daemon to detect problems with the plurality of devices that 
are power line devices. 

12. The architecture of claim 11, wherein the power line monitoring daemon uses pattern- 
based detection for detecting unacceptable power line activity. 

13. The architecture of claim 12, wherein the power line monitoring daemon matches 
power line patterns against unacceptable power line patterns stored in a pattern database. 

14. The architecture of claim 11, wherein the power line monitoring daemon uses model- 
based detection for detecting acceptable power line activity. 
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15. The architecture of claim 14, wherein the power line monitoring daemon tests power 
line patterns against a pattern model of acceptable power line patterns. 
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ABSTRACT OF THE DISCLOSURE 

Power line monitoring is disclosed. The monitoring can be performed in 
conjunction with an automation system designed to control and monitor devices and 
sensors. Model-based power line monitoring uses a model of acceptable power line 
activity. Activity that does not conform to the model is tagged as indicating a potential 
problem. Pattern-based power line monitoring uses patterns of unacceptable power line 
activity. Activity that matches one of the patterns is also tagged as indicating a potential 
problem. 
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